Data for improvement and clinical excellence: protocol for an audit with feedback intervention in long-term care

<p>Abstract</p> <p>Background</p> <p>There is considerable evidence about the effectiveness of audit coupled with feedback, although few audit with feedback interventions have been conducted in long-term care (LTC) settings to date. In general, the effects have been found to be modest at best, although in settings where there has been little history of audit and feedback, the effects may be greater, at least initially. The primary purpose of the Data for Improvement and Clinical Excellence (DICE) Long-Term Care project is to assess the effects of an audit with feedback intervention delivered monthly over 13 months in four LTC facilities. The research questions we addressed are:</p> <p indent="1">1. What effects do feedback reports have on processes and outcomes over time?</p> <p indent="1">2. How do different provider groups in LTC and home care respond to feedback reports based on data targeted at improving quality of care?</p> <p>Methods/design</p> <p>The research team conducting this study comprises researchers and decision makers in continuing care in the province of Alberta, Canada. The intervention consists of monthly feedback reports in nine LTC units in four facilities in Edmonton, Alberta. Data for the feedback reports comes from the Resident Assessment Instrument Minimum Data Set (RAI) version 2.0, a standardized instrument mandated for use in LTC facilities throughout Alberta. Feedback reports consist of one page, front and back, presenting both graphic and textual information. Reports are delivered to all staff working in the four LTC facilities. The primary evaluation uses a controlled interrupted time series design both adjusted and unadjusted for covariates. The concurrent process evaluation uses observation and self-report to assess uptake of the feedback reports. Following the project phase described in this protocol, a similar intervention will be conducted in home care settings in Alberta. Depending on project findings, if they are judged useful by decision makers participating in this research team, we plan dissemination and spread of the feedback report approach throughout Alberta.</p

Development and assessment of the Alberta Context Tool

<p>Abstract</p> <p>Background</p> <p>The context of healthcare organizations such as hospitals is increasingly accepted as having the potential to influence the use of new knowledge. However, the mechanisms by which the organizational context influences evidence-based practices are not well understood. Current measures of organizational context lack a theory-informed approach, lack construct clarity and generally have modest psychometric properties. This paper presents the development and initial psychometric validation of the Alberta Context Tool (ACT), an eight dimension measure of organizational context for healthcare settings.</p> <p>Methods</p> <p>Three principles guided the development of the ACT: substantive theory, brevity, and modifiability. The Promoting Action on Research Implementation in Health Services (PARiHS) framework and related literature were used to guide selection of items in the ACT. The ACT was required to be brief enough to be tolerated in busy and resource stretched work settings and to assess concepts of organizational context that were potentially <it>modifiable</it>. The English version of the ACT was completed by 764 nurses (752 valid responses) working in seven Canadian pediatric care hospitals as part of its initial validation. Cronbach's alpha, exploratory factor analysis, analysis of variance, and tests of association were used to assess instrument reliability and validity.</p> <p>Results</p> <p>Factor analysis indicated a 13-factor solution (accounting for 59.26% of the variance in 'organizational context'). The composition of the factors was similar to those originally conceptualized. Cronbach's alpha for the 13 factors ranged from .54 to .91 with 4 factors performing below the commonly accepted alpha cut off of .70. Bivariate associations between instrumental research utilization levels (which the ACT was developed to predict) and the ACT's 13 factors were statistically significant at the 5% level for 12 of the 13 factors. Each factor also showed a trend of increasing mean score ranging from the lowest level to the highest level of instrumental research use, indicating construct validity.</p> <p>Conclusions</p> <p>To date, no completely satisfactory measures of organizational context are available for use in healthcare. The ACT assesses several core domains to provide a comprehensive account of organizational context in healthcare settings. The tool's strengths are its brevity (allowing it to be completed in busy healthcare settings) and its focus on dimensions of organizational context that are modifiable. Refinements of the instrument for acute, long term care, and home care settings are ongoing.</p

Advancing the argument for validity of the Alberta Context Tool with healthcare aides in residential long-term care

<p>Abstract</p> <p>Background</p> <p>Organizational context has the potential to influence the use of new knowledge. However, despite advances in understanding the theoretical base of organizational context, its measurement has not been adequately addressed, limiting our ability to quantify and assess context in healthcare settings and thus, advance development of contextual interventions to improve patient care. We developed the Alberta Context Tool (the ACT) to address this concern. It consists of 58 items representing 10 modifiable contextual concepts. We reported the initial validation of the ACT in 2009. This paper presents the second stage of the psychometric validation of the ACT.</p> <p>Methods</p> <p>We used the <it>Standards for Educational and Psychological Testing </it>to frame our validity assessment. Data from 645 English speaking healthcare aides from 25 urban residential long-term care facilities (nursing homes) in the three Canadian Prairie Provinces were used for this stage of validation. In this stage we focused on: (1) advanced aspects of internal structure (e.g., confirmatory factor analysis) and (2) relations with other variables validity evidence. To assess reliability and validity of scores obtained using the ACT we conducted: Cronbach's alpha, confirmatory factor analysis, analysis of variance, and tests of association. We also assessed the performance of the ACT when individual responses were aggregated to the care unit level, because the instrument was developed to obtain unit-level scores of context.</p> <p>Results</p> <p>Item-total correlations exceeded acceptable standards (> 0.3) for the majority of items (51 of 58). We ran three confirmatory factor models. Model 1 (all ACT items) displayed unacceptable fit overall and for five specific items (1 item on <it>adequate space for resident care </it>in the Organizational Slack-Space ACT concept and 4 items on use of electronic resources in the Structural and Electronic Resources ACT concept). This prompted specification of two additional models. Model 2 used the 7 scaled ACT concepts while Model 3 used the 3 count-based ACT concepts. Both models displayed substantially improved fit in comparison to Model 1. Cronbach's alpha for the 10 ACT concepts ranged from 0.37 to 0.92 with 2 concepts performing below the commonly accepted standard of 0.70. Bivariate associations between the ACT concepts and instrumental research utilization levels (which the ACT should predict) were statistically significant at the 5% level for 8 of the 10 ACT concepts. The majority (8/10) of the ACT concepts also showed a statistically significant trend of increasing mean scores when arrayed across the lowest to the highest levels of instrumental research use.</p> <p>Conclusions</p> <p>The validation process in this study demonstrated additional empirical support for construct validity of the ACT, when completed by healthcare aides in nursing homes. The overall pattern of the data was consistent with the structure hypothesized in the development of the ACT and supports the ACT as an appropriate measure for assessing organizational context in nursing homes. Caution should be applied in using the one space and four electronic resource items that displayed misfit in this study with healthcare aides until further assessments are made.</p

Exploring the role of organizational policies and procedures in promoting research utilization in registered nurses

<p>Abstract</p> <p>Background</p> <p>Policies and procedures (P&Ps) have been suggested as one possible strategy for moving research evidence into practice among nursing staff in hospitals. Research in the area of P&Ps is limited, however. This paper explores: 1) nurses' use of eight specific research-based practices (RBPs) and RBP overall, 2) nurses' use and understanding of P&Ps, and 3) the role of P&Ps in promoting research utilization.</p> <p>Methods</p> <p>Staff nurses from the eight health regions governing acute care services across the Canadian province of Newfoundland and Labrador completed an anonymous questionnaire regarding their use of eight RBPs and associated P&Ps. Data were also obtained from authorities in six of the eight regions about existing relevant P&Ps. We used descriptive statistics and multivariate regression analysis to assess the relationship between key independent variables and self-reported use of RBP.</p> <p>Results</p> <p>Use of the eight RBPs ranged from 7.8% to 88.6%, depending on the practice. Nurses ranked P&P manuals as their number one source of practice knowledge. Most respondents (84.8%) reported that the main reason they consult the P&P manual is to confirm they are practicing according to agency rules. Multivariate regression analysis identified three significant predictors of being a user versus non-user of RBP overall: awareness, awareness by regular use, and persuasion. Six significant predictors of being a consistent versus less consistent user of RBP overall were also identified: perception of P&P existence, unit, nursing experience, personal experience as a source of practice knowledge, number of existing research-based P&Ps, and lack of time as a barrier to consulting P&P manuals.</p> <p>Conclusion</p> <p>Findings suggest that nurses use P&Ps to guide their practice. However, the mere existence of P&Ps is not sufficient to translate research into nursing practice. Individual and organizational factors related to nurses' understanding and use of P&Ps also play key roles. Thus, moving research evidence into practice will require careful interplay between the organization and the individual. P&Ps may be the interface through which this occurs.</p

Study protocol for the translating research in elder care (TREC): building context – an organizational monitoring program in long-term care project (project one)

<p>Abstract</p> <p>Background</p> <p>While there is a growing awareness of the importance of organizational context (or the work environment/setting) to successful knowledge translation, and successful knowledge translation to better patient, provider (staff), and system outcomes, little empirical evidence supports these assumptions. Further, little is known about the factors that enhance knowledge translation and better outcomes in residential long-term care facilities, where care has been shown to be suboptimal. The project described in this protocol is one of the two main projects of the larger five-year Translating Research in Elder Care (TREC) program.</p> <p>Aims</p> <p>The purpose of this project is to establish the magnitude of the effect of organizational context on knowledge translation, and subsequently on resident, staff (unregulated, regulated, and managerial) and system outcomes in long-term care facilities in the three Canadian Prairie Provinces (Alberta, Saskatchewan, Manitoba).</p> <p>Methods/Design</p> <p>This study protocol describes the details of a multi-level – including provinces, regions, facilities, units within facilities, and individuals who receive care (residents) or work (staff) in facilities – and longitudinal (five-year) research project. A stratified random sample of 36 residential long-term care facilities (30 urban and 6 rural) from the Canadian Prairie Provinces will comprise the sample. Caregivers and care managers within these facilities will be asked to complete the TREC survey – a suite of survey instruments designed to assess organizational context and related factors hypothesized to be important to successful knowledge translation and to achieving better resident, staff, and system outcomes. Facility and unit level data will be collected using standardized data collection forms, and resident outcomes using the Resident Assessment Instrument-Minimum Data Set version 2.0 instrument. A variety of analytic techniques will be employed including descriptive analyses, psychometric analyses, multi-level modeling, and mixed-method analyses.</p> <p>Discussion</p> <p>Three key challenging areas associated with conducting this project are discussed: sampling, participant recruitment, and sample retention; survey administration (with unregulated caregivers); and the provision of a stable set of study definitions to guide the project.</p

Nursing home administrators’ perspectives on a study feedback report : a cross sectional survey

BackgroundThis project is part of the Translating Research in Elder Care (TREC) program of research, a multi-level and longitudinal research program being conducted in 36 nursing homes in three Canadian Prairie Provinces. The overall goal of TREC is to improve the quality of care for older persons living in nursing homes and the quality of work life for care providers. The purpose of this paper is to report on development and evaluation of facility annual reports (FARs) from facility administrators&rsquo; perspectives on the usefulness, meaningfulness, and understandability of selected data from the TREC survey. MethodsA cross sectional survey design was used in this study. The feedback reports were developed in collaboration with participating facility administrators. FARs presented results in four contextual areas: workplace culture, feedback processes, job satisfaction, and staff burnout. Six weeks after FARs were mailed to each administrator, we conducted structured telephone interviews with administrators to elicit their evaluation of the FARs. Administrators were also asked if they had taken any actions as a result of the FAR. Descriptive and inferential statistics, as well as content analysis for open-ended questions, were used to summarize findings. ResultsThirty-one facility administrators (representing thirty-two facilities) participated in the interviews. Six administrators had taken action and 18 were planning on taking action as a result of FARs. The majority found the four contextual areas addressed in FAR to be useful, meaningful, and understandable. They liked the comparisons made between data from years one and two and between their facility and other TREC study sites in their province. Twenty-two indicated that they would like to receive information on additional areas such as aggressive behaviours of residents and information sharing. Twenty-four administrators indicated that FARs contained enough information, while eight found FARs &lsquo;too short&rsquo;. Administrators who reported that the FAR contained enough information were more likely to take action within their facilities than administrators who reported that they needed more information. ConclusionsAlthough the FAR was brief, the presentation of the four contextual areas was relevant to the majority of administrators and prompted them to plan or to take action within their facility. <br /

Interventions aimed at increasing research use in nursing: a systematic review

<p>Abstract</p> <p>Background</p> <p>There has been considerable interest recently in developing and evaluating interventions to increase research use by clinicians. However, most work has focused on medical practices; and nursing is not well represented in existing systematic reviews. The purpose of this article is to report findings from a systematic review of interventions aimed at increasing research use in nursing.</p> <p>Objective</p> <p>To assess the evidence on interventions aimed at increasing research use in nursing.</p> <p>Methods</p> <p>A systematic review of research use in nursing was conducted using databases (Medline, CINAHL, Healthstar, ERIC, Cochrane Central Register of Controlled Trials, and Psychinfo), grey literature, ancestry searching (Cochrane Database of Systematic Reviews), key informants, and manual searching of journals. Randomized controlled trials and controlled before- and after-studies were included if they included nurses, if the intervention was explicitly aimed at increasing research use or evidence-based practice, and if there was an explicit outcome to research use. Methodological quality was assessed using pre-existing tools. Data on interventions and outcomes were extracted and categorized using a pre-established taxonomy.</p> <p>Results</p> <p>Over 8,000 titles were screened. Three randomized controlled trials and one controlled before- and after-study met the inclusion criteria. The methodological quality of included studies was generally low. Three investigators evaluated single interventions. The most common intervention was education. Investigators measured research use using a combination of surveys (three studies) and compliance with guidelines (one study). Researcher-led educational meetings were ineffective in two studies. Educational meetings led by a local opinion leader (one study) and the formation of multidisciplinary committees (one study) were both effective at increasing research use.</p> <p>Conclusion</p> <p>Little is known about how to increase research use in nursing, and the evidence to support or refute specific interventions is inconclusive. To advance the field, we recommend that investigators: (1) use theoretically informed interventions to increase research use, (2) measure research use longitudinally using theoretically informed and psychometrically sound measures of research use, as well as, measuring patient outcomes relevant to the intervention, and (3) use more robust and methodologically sound study designs to evaluate interventions. If investigators aim to establish a link between using research and improved patient outcomes they must first identify those interventions that are effective at increasing research use.</p

A modest start, but a steady rise in research use: a longitudinal study of nurses during the first five years in professional life

<p>Abstract</p> <p>Background</p> <p>Newly graduated nurses are faced with a challenging work environment that may impede their ability to provide evidence-based practice. However, little is known about the trajectory of registered nurses' use of research during the first years of professional life. Thus, the aim of the current study was to prospectively examine the extent of nurses' use of research during the first five years after undergraduate education and specifically assess changes over time.</p> <p>Method</p> <p>Survey data from a prospective cohort of 1,501 Swedish newly graduated nurses within the national LANE study (Longitudinal Analyses of Nursing Education and Entry in Worklife) were used to investigate perceived use of research over the first five years as a nurse. The dependent variables consisted of three single items assessing instrumental, conceptual, and persuasive research use, where the nurses rated their use on a five-point scale, from 'never' (1) to 'on almost every shift' (5). These data were collected annually and analyzed both descriptively and by longitudinal growth curve analysis.</p> <p>Results</p> <p>Instrumental use of research was most frequently reported, closely followed by conceptual use, with persuasive use occurring to a considerably lower extent. The development over time showed a substantial general upward trend, which was most apparent for conceptual use, increasing from a mean of 2.6 at year one to 3.6 at year five (unstandardized slope +0.25). However, the descriptive findings indicated that the increase started only after the second year. Instrumental use had a year one mean of 2.8 and a year five mean of 3.5 (unstandardized slope +0.19), and persuasive use showed a year one mean of 1.7 and a year five mean of 2.0 (unstandardized slope +0.09).</p> <p>Conclusion</p> <p>There was a clear trend of increasing research use by nurses during their first five years of practice. The level of the initial ratings also indicated the level of research use in subsequent years. However, it took more than two years of professional development before this increase 'kicked in.' These findings support previous research claiming that newly graduated nurses go through a 'transition shock,' reducing their ability to use research findings in clinical work.</p

Assessment of variation in the alberta context tool: the contribution of unit level contextual factors and specialty in Canadian pediatric acute care settings

Background: There are few validated measures of organizational context and none that we located are parsimonious and address modifiable characteristics of context. The Alberta Context Tool (ACT) was developed to meet this need. The instrument assesses 8 dimensions of context, which comprise 10 concepts. The purpose of this paper is to report evidence to further the validity argument for ACT. The specific objectives of this paper are to: (1) examine the extent to which the 10 ACT concepts discriminate between patient care units and (2) identify variables that significantly contribute to between-unit variation for each of the 10 concepts. Methods: 859 professional nurses (844 valid responses) working in medical, surgical and critical care units of 8 Canadian pediatric hospitals completed the ACT. A random intercept, fixed effects hierarchical linear modeling (HLM) strategy was used to quantify and explain variance in the 10 ACT concepts to establish the ACT’s ability to discriminate between units. We ran 40 models (a series of 4 models for each of the 10 concepts) in which we systematically assessed the unique contribution (i.e., error variance reduction) of different variables to between-unit variation. First, we constructed a null model in which we quantified the variance overall, in each of the concepts. Then we controlled for the contribution of individual level variables (Model 1). In Model 2, we assessed the contribution of practice specialty (medical, surgical, critical care) to variation since it was central to construction of the sampling frame for the study. Finally, we assessed the contribution of additional unit level variables (Model 3). Results: The null model (unadjusted baseline HLM model) established that there was significant variation between units in each of the 10 ACT concepts (i.e., discrimination between units). When we controlled for individual characteristics, significant variation in the 10 concepts remained. Assessment of the contribution of specialty to between-unit variation enabled us to explain more variance (1.19% to 16.73%) in 6 of the 10 ACT concepts. Finally, when we assessed the unique contribution of the unit level variables available to us, we were able to explain additional variance (15.91% to 73.25%) in 7 of the 10 ACT concepts. Conclusion: The findings reported here represent the third published argument for validity of the ACT and adds to the evidence supporting its use to discriminate patient care units by all 10 contextual factors. We found evidence of relationships between a variety of individual and unit-level variables that explained much of this between-unit variation for each of the 10 ACT concepts. Future research will include examination of the relationships between the ACT’s contextual factors and research utilization by nurses and ultimately the relationships between context, research utilization, and outcomes for patients